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ABSTRACT 

This paper reports the results obtained with a group of 24 14-year-old pupils when 
presented Hth sats of algebra tasks by the Leeds Modelling System, LMS. Four months later, 
these same pupils were given a comparable paper-and-pencil test and detailed Interviews. A 
comparison between these sets of results 1s presented* 

The results obtained on the paper-and-penc11 test and the Interviews were consistent, and 
show that the pupils had some profound misunderstandings of algebraic notation. Further, from 
the interviews it 1s possible. to determine, classes of strategies some pupils were using, 
namely; 

-searching for solutions (1e substituting), 

-applying a "global" rule, such as collecting ALL the numbers on one side, whether or not they 
were coefficients. 

Moreover^this work further demonstrates the importance of interviews to Interpret curious 
protocols. 



♦Current address: Heuristic Programming Project, Department of Computer Science, STANFORD 
University, CALIFORNIA 94305. 
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1. INTRODUCTION 



In 197« we implemented a Computer-based modelling system, LMS - Leeds Modelling System 
(Sleeman & Smith, 1931) and at the same time collected and analysed protocols for 16-year-old 
pupils solving basic algebra. tasks. A set of rules were fonmlated which wore sufficient to 
solve the tasks, and the errors which the pupils made were expressed as Incorrect, or 
mil-rules. Mal-rules noted Includes moving a number from one side of the equation and omitting 
to change the sign; multiplying some, but not all, of the terms of bracketed expressions, etc. 
(We have subsequently called these maninuiaHup mal-rules as we believe such pupils know the 
rules but make an error In their execution). The domain rules, the associated mal-rules and 
sets of tasks form LMS's algebra database. See figure la'Vor algebra domain rules, and figure 
lb for some of the mal-rules noted. 



In March 1980, a small group of pupils, average age 14 years 10 months, used the modeller, 
and by and large 1t was able to spot their difficulties. Indeed, the same pupils were. seen a 
few days later by some experimenters, whose assessment of the pupils' performance agreed vary 
closely with those of the modeller (Sleeman, 1982). Some shortcomings were noted 1n the 
modeller during this experiment, namely that it was unable to spot difficulties with rules 
other than at the "level" at which they were first introduced, Diring the 1980 experiment, we 
saw ample evidence that when tasks became more complex, pupils would make errors with simpler 
rules too. For example, pupils would be able to successfully work tasks of the type: 

M»X - N 

[where M and H stand for integers] 

but when the task Involved expanding brackets we noted pupils who appeared to do that 
successfully, but inverted the final answer. Given the task: 

12'X 2 • (4'X + 5) 
we have seen several times the answer: 



[Figure 1 about here] 
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This shortcoming was/removed from the modeller (Sieeman, 1983a) and 1n May 1681 another group 
of pupils used LMS with the.iMfi database. This group of 24 pupil., average age 14 years 3 
months, were judged/ to be at or above the national average for their age-group In Mathematics; 
however the results were flrm a tlfi B U jt different from the earlier group's. [1]. indeed many of 
their difficulties/ were not diagnosed by LMS and had to be analysed by the Investigator. This 
task was mad. ve/y. difficult because 1t had been. assumed that pupil, would at most make one or 
.two minor manipulative errors (e.g. changing side and not sign) and so LMS had been designed 
such that thu /pupil could merely input his final ans^r. and none of his Intermediary steps. 
In figure 2 w. «jlv. a sample of the protocols observed, together with the m.al-rules which the 
iUMAUmu. suggested were appropriate. In figure 3. we summarise the new mal-rules which the 
Investigator considered explained the pupils' behaviour with LMS. 

By stating that a protocol can be explained by a mal-rule of the form 
/ M«X -> M+X 

we do nal wish to imply that given a task of the type: 
/ 3«X * 4«X ■ 6 

the pupil would produce the response: 

' 3+X ♦ 4+X ■ 6 

Indeed, w. have seen several pupils write 

/ X+X^»- 5-3r4 

and when asked to provide Intermediary steps they have said categorically that there were none 
as the. above was done In "one step" (figure 2a) . Nevertheless, we are happy to accept that 
both forms are "explained" by the mal-rule: the first form however requires that several 
additional rules fire In order to get U Into the state given by the "second" pupil. (It 
Shoulfl" be noted that the mal-rules given In figures 2d and 2e are more comprehensive and carry 
out /several housekeeping steps). Note that the difference between "basic" and "comprehensive" 
mal-rrules i* significant when one tries to per rorm remedial Instruction, as it is Important to 
ensure that the grain of the Instruction matches the pupil's. 

[Figures 2 and 3 about here] 

Further as the result of the analysis of these protocols, a number of questions were 



1. Most of these pupils had been introduced to algebra several years earlier in thair <OJ «r S i 
middle schools; furthermore the high school had retL ht" e ! y t f ? 
beginning - in the year before the experiment took place. y 
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raised, Including: 

- What is th« essential difference between the task-sets which the pupil can and cannot so1vg7 

- Ooes the pupil's perception of algebraic tasks vary from one task-type to another7 

(See figure 4a for a list of task-types given to the pupils and (Sleeman, 1982 & \983a) for a 
more detailed discussion of how this set was constructed). 

Unfortunately, because this analysis took a while and the school vacation then intervened, 
it was not possible to meet with the pupils again until September (1981). Because of the time 
that had elapsed, the pupils were given a paper-and-pencil test which covered comparable tasks 
to those set by LMS. These tests were analysed in detail by the investigator, and as a result 
of this certain pupils were given detailed diagnostic interviews. The next sections give more 
details of these stages. 



Figure 4b gives a comparison between the performance of selected pupils in May and 
September. We hav» omitted those pupils who did well on both, and those whose only error was 
incorrect precedence in tasks of the type; 



as this proved to oe & virtually universal error. (Such pupils would return the answer 
5X ■ 6 for the above task. This was also a very common error in our earlier study, (Sleeman, 
1982). Note we also classify this as a parsing error - many other parsing errors were noted 1n 
this experiment.) 

From a review of the data we noted: 

1. The performance was generally considerably better in September than in May. (Note aa 
additional leaching in algebra had been given, however the pupils had presumably done 
some independent study in preparation for their end of year examinations). 

2. A considerable number of tasks were nfli solved on the written test - (whereas LMS 



[Figure 4 about here] 



2. THE PAPER-and-PENCIL TEST 



2 ♦ 3X ■ 8 



Insisted on the pupil giving a response to each question). 
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3. Some pupils who appeared to have -wild" rules In May, seemed to solve this type of 
task correctly In September , eg A85, or had less "serious" mal -rules. 

• 4. Some pupils whose behaviour had been "random" or "wild" In May had now settled to use 
Incorrect rules consistently, e.g. pupil AB18. 

5. One pupil at least. AB7, gave multiple values In an equation where X occurred more 
than once. 

8. Many of the pupils made the common precedence error noted above. 

As a result of this comparison it was decided to Interview all those who appeared, on the 
written test, still to have major difficulties- and all those who had had major difficulties 
which appeared to have "cleared up". (But not those with the common precedence errors). 



3. THE INTERVIEWS 

These proved to be remarkably revealing and very rewarding as the pupils without exception 
were extremely articulate. The dialogues were taped, and tho figures are a reconstruction from 
the tapes and the worksheets used, 

After analysing the pupils' protocols obtained with LMS we conjectured that some pupils 
may actually "see" some of these tasks differently from the standard algebraic interpretation. 
That is a pupil like ABltJ, we conjectured, might actually see a task of the type: 

MX+NX-P asM*X+N+X*P 

To test this hypothesis we started each interview by asking the pupil merely to uivL the 
11st of algebra tasks given, in figure 5. Each pupil without exception r^d them correctly but. 

some pupils like AB18. still processed themes indicated above (more details are given in 
section 3.4). 

[Figure 5 about here] 

In all cases the investigator then presented the pupil with a series of tasks and asked 
him to work each one explaining as he went along exactly *ut he was doing, in some cases the 
investigator asked the pupil to tell him which of two alternative forms were correct and to 
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explain why. The tasks presented were different for ^ar h "«il, and were based on the 



session with a 11st of task-types to be explored, but often generated particular tasks as a 
result of answers given to questions. (For example, some pupils were Initially asked to rework 
the tasks they had apparently done 1n "interesting" ways 1n the September trst). 

The following is a summary of the main features noted during the interviews: 

1. Some pupils searched for solutions as they were unable to compute MX * NX and/or deal 



2. One pupil computed a separate value for each x given in the equation* 

3. Several pupils admitted that there were a number of quite distinct ways of solving an 
equation (even when it 1s demonstrated that each different approach leads to different 
answers). 

4. Some pupils have "hard", consistent, mal-rules. 

5. Some pupils have the correct rules and can explain why 1t 1s not permissible to 
perform the Illegal transformation (frequently the one the pupil appeared to use in 
May was selected) . 



Each of these points are discussed in the following sub-sections. 



difficulties noted in the individual's September test. TI; 



ewer thus started each 



0 



with MX ■ N. when M>N. 
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3.-1 Ssar^ins Ian Sflluliam 

Searching for a solution appears to be a mi common way of solving equations with pupils 
beginning algebra, and presumably arises because the Initial equations presented could be 
solved using this algor'hm. (See figure 6.1 for details of pupil ABll's protocol, [2]). 
Teachers should thus' be suspicious that a pupil Is using the naive algorithm 1f he appears to 
be unable to solve tasks where the variable 1s a negative integer. large-Integer or 
non-Integer. The teacher should be concerned because the naive algorithm 1s only applicable to 
a sub-set of algebraic equations, and hence should b» deemed a highly significant weakness to 
be remedied. It seems clear that the use of simplistic tas<s leads to a naive algorithm which 
causes major conceptual difficulties on more advanced tasks, "3]. 

[Figure 6 about here] 



2. Indeed, in a more recent test with 100 13-year-olds, 1t appears that about 95% of them use 
this approach. And we argue that this leads to the type of errors noted below for tasks where 
this naive algorithm is inappropriate. For instance a significant proportion experience 
difficulties with tasks of the form 

3X - 2 

Many of them return the answer: 

X«-i, explaining they had subtracted 3 f ro m both sides. * ."c 

These same pupils completajy fail on equations which contain 2 Xs and attempt to guess a 
value for eac^ x. 

3*X+4«X»3 

has been "solved" as: 

3*1 ♦ 4*0 ■ 3 t making X«l and X-0. 

Similarly, 

3X ♦ 4X - 98 

has been "solved" as: 

3*22 ♦ 4*8 • 66 *■ 32 « 98. 

It is indeed intriguing to watch these pupils changing their approach when solving tasks 
of the form: 

MX»N 

depending on whether the task is solvable by search. They do not appear to notice this 
discrepancy. [Clearly this point should have been raised in an interview with these pupils]. 



3. S;me readers may prefer to think about the method discussed in section 3.1 as being a 
co nsistent substitution method, and the one discussed in section 3.2 as an iocujii. :;n,» 
substitution method. 
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3.2 Multiple Values t&L I, [3] 

In this section wo report a pupil who has a very weird, but nevertheless very consist^ 
algorithm for solving tasks Involving 2 Xs. (The 13-year-old pupils quoted above displayed the 
same general phenomena but were generally arbitrary in their choices for X, [2]). When pupil 
AB7 was oHgnally working at the terminal she was heard to mutter; 

"If this X was 2, then it would work if this second X was 4". 

Moreover, in both the paper-and-pendl exercise and in the Interview this pupil had been 
remarkably consistent. (See figure 6.2 for her protocol). That a pupil would follow such an 
algorithm was originally a yreat source of amazement to me^ and I should add to the School's 
Maths teachers. 

On the other hand, pupil AB7 was able to explain exactly what she was doing. Given '.he 

task: 

3 • X + 2 • X ■ 12 
1e task e) of figure 6.2 she gave the following explanation: 
"What I do 1s take the 3 and I make the first X equal to 2, so I write; 3 • 2 H 

When asked by the interviewer why the first X 1s equal to 2. she explained that it's the next 
number along, and then added "I think that's wrong, but that's what I do". 

She then continued " and then I write down the +2 making 

3 • 2 * 2 

I then work this out, this is equal to 8 and so the second X is 

12 - 8, that 1s 4". 

She then completed the solution and gave the 2 values for X, and so the final state of her 
worksheet was: 

3 • 2 + 2 + 4 - 12 
X - 2 
X ■ 4 

NB She worked tasks c to k using this "algorithm", but us*d a variant with tasks, a and h. 
Tasks 1 to o show she was clearly solving these tasks by "searching", c.f., figure 6.1. 
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3.3 fiUftrnftMyp Alamillim 

Figure 6.3 gives the flavour of the dialogue between this pupil and the Interviewer. 
Although for several task-types pupil AB17 was able to solve the tasks correctly, he was easily 
distracted and quite unable to ttll the investigator why his alternatives were Illegal. On 
some tasks he suggested usual Illegal solutions, and again was really unable to distinguish 
between them. 

Moreover, this pupil gave, as an aside, a rationale for his "method' . which 1s discussed 
in section 4c. 



3.4 "RamVConsistant. Ma1-Ru1o« 

Many of the pupils were using consistent mal-rules. Just over half of the 24 pupils we 
saw mis-handled precedence 1n equations of the form: 

2 * 3«X ■ 9 

A section for one such pupil is given In figure 6.4.1. (Indeed, more recently we have 
discovered that 90% of' a sample of 13-year-olds had precedence difficulties with arit h metic 
expressions involving the and ••- operators). Figure 6. 4. II 1s part of a protocol where 
pupil AB17 consistently applies a further Intriguing transformation to a complete set of tasks. 
{A more detailed explanation for this protocol 1s given 1n section 4c). 

Pupil AB18. figure 6. 4. III. 1s remarkably consistent with his mal-rules over a whole ran, 
of task-types. NB. the application o,f his algorithm to task c which Involves 3 X-terms. (To 
give him justice. h 8 real!sed that he had got tasks. d) - g) wrong as he noticed that the 
equations did not balance when he substituted his answers back In). Further, having worked 
task h) he noticed that when he moved the 4 across to the Right Hand Side, he changed the. sign 
and suggested that when he move the X (associated with 2«X) to the LHS. he should also change 
Its sign. He then verbalized that 

X - X 1s 0. 

and so the LHS became 0 and the RHS did 001, and so he realized that this proposed solution was 
impossible. However, for good maasure he also worked task 1) with the "revised" algorithm. 
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In the course of our discussion this pupil also gave the basis for his algorithm, which 1s 
discussed 1n more detai 1 In Section 4.c. 

3.5 " Savao; Soula " 

In figure 6,5 we see pupil AB6 working correctly tasks which she had got constantly 
wrong 1n May, namely task sets 7 and 8. For task set 8 she ap^ared to use mal-rule; 

M*X ■ N*X + P ■■> X+X«M + N + P, 
Moreover, when presented with a fallacious alternative during the interview she was able to 
spot it and to say aJut 1t was wrong. ("Not able to add a number to an X term", "not able to 
separate a number from an X term" etc., see the figure for more details). 

In May, this pupil showed a lack of understanding of basic algebraic notation which 
appeared to be remedied by September. To see whether this was the case I also presented tasks 
from task sets 12 and 13, namely tasks e to h, which she worked correctly and was able to 
verbal iie the stages she went ihrough. I also presented equation 1) which contained an unusuai 
variable, AA, and again this was worked correctly. 

Similarly several other pupils, eg. AB4 showed substantial progress, and again 1t was 
associated with the ability to flAftlAiH, what they were doing. In the next section we give a 
summary of the points Inferred from these various analyses, 

4. SUMMARY OF THE EXPERIMENT ' 
There appear to be five major, and ngt totally unrelated, points: 

« 

a) IjlA apparent difficulty fl£ tasks involving multiply 

In the introduction, we 1 isted^number of questions which occurred to us. follgwing an 
analysis of the pupils' protocols with LMS. These included the observation that some pupils 
could solve certain earlier task-types, but appeared to ail on a particular set, and yet can 
subsequently go on to solve further sets. In particular, we had noticed pupils having 
difficulties with tasks of type: 

12 
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2X ♦ 3X - 10 

yet be able to solve tasks of type: 

2X + 4 • lfl and 4 + 2X ■ 18. 

From talking to^the pupils It became clear that they were searching for a solution, 
*"au i H they did 201 know how to compute the sum of MX and NX. The second and .third tasks thus 
appear e aa lnr to them because 1t did not contain this "difficulty". Thus, the Interviews very 
nicely resolved this Issue. 



b) M.il-Rnlaj ratainad nanuina '\ * 

As a result of the Interviews we believe that many of the mal-rules reported In figure 3 
are -phantom" and a result of the pupil having to give a response to IMS. Indeed, we now 
believe mal-rules sets 4 and 6 are spurious. (The modeller has since been changed so that 1t 
1s now possible for the pupil to 1nHc, .„ that he wishes to give up on a particular task). 
Al.o there are additional mal-rules that .■ id be added, namely those which can be genercted 
by the schema discussed in the next section. 



C) Schema Ian "Generating" Ma1-Bn1«« 

In figure 6.4. Ill we gave a substantial section of pupil ABlB's protocol. In the course 
of our discussion he explained that he was carrying out the teacher-given algorithm of: 
"Collecting all the Xs on the left hand side and collecting all the numbers on the right hand 
side", and added that he was not really sure what to do about the "extra multiply signs". 
Pupil AB17 gave a similar explanation for his action. 

This gives us a i£A£ma for generating mal-rules. For example given the task-type: 

M"X + N'X ■ P 

This schema gives the following action sides for mal-rules: 

X+X ■ P-M-N 
X+X - P+M+N 

wnere in the second case the X coefficients are treated "specially", 1e the coefficients of the 
Xs ware taxen across to the RHS of the equation but the signs were NOT changed. And the form 
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given by pupil AB17, and quoted 1n figure 6. 4. II, namely: 

•X*X»P-M-N 

This form, I believe, was recognized as being non-standard, and so the pupn changed 1t Into a 
more recognizable form, namely: 

X*X«P-M-N 

The "complementary" form belnfl: 

J X*X«P+M+N 
(For further examples of "normalization" see (Sleeman, 1982)), 

i . • 

Similarly, given the task-type: 

M*X • N*X + P 

This schema creates the following 'orms: 
X - N P - M 
X - N * P ♦ M 



X * X - N * P - M \ 

f. 



X + X- N + P+ M 

X-X-N + P- M r 
X-X-N + P+ M 

For example, on task h pupil AB18 suggested the use of both the third and the f1f*th forms 
(see figure 5, 4. Ill), 



ill 



Brown and Burton's earlier modelling work (Brown & Burton, 1978) assumed that pujpH errors 
were due to perturbations of the correct rules (c.f., the assumptions which we als^made 
Initially 1n this project, and which seems to be true for soma of this domain's rules). This 
however, 1s certainly asl true for the class of errors which we are discussing here. Indeed, 
pupils AB18 and AB17 do aol use the usual "task segmentation" and thus do not even consider; 
applying, at the first step, a correct rule (Sleeman, 1983b). On the other hand, It appears 
possible to generate all the manipulativg mal-rules by systematically removing one of the 
rule's sub-steps (Sleeman, 1983b). 
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d) Lcr 3 <♦•.:<!■» flip Sturtip.^ 

From this set of pupil, alone, I think It Is possible to Infer that behaviour progresses 

as: 

UNPREDICTABLE/ "WILD" -> CONSISTENT USE of MAL-RULES- -> CORRECT 

That is. pupils who were really unsure which method to use. c.f.. pupil AB17 of figure 
6.3. would apply different "methods" to different tasks apparently randomly. (Analogously. 
Greeno and his collaborators who are Investigating pupil,' performance whilst they are being 
taught algebra, have noticed very considerable variations over time for the individual pupils 
C«rt.,o. 1M1)). Then there are the pupils, c.f.. figure 6.4. who are using consistent 
mal-rules on particular task sets. Further there are some, like pupil AB18 of figure 6.4. III. 
who are using a schema which guides their action in a whole variety of situations. Moreover, 
once the correct algorithms are understood it appears that pupils are able to explain them 
quite articulately. 

With experience or maturation pupils to move through the stages given above. I do 

not wish to suggest that euu* pupil acquires a consistent mal-rule before he Is able to do the 
task correctly, but to indicate a trend. Similarly. I do m wish to suggest that no pupil 
regresses. Results obtained over a period of a year and a half, with various groups aged from 
13 to 15 support this claim, as does the study reported In (Kuechemann, 1901). 



e) Interpretation Ql iJtt uuHfliiS. Iro al Mal-Rul^ 4 Ufi Remedial Teaching Ex periment. 

As mentioned earlier, prior to meeting this group of pupils we had anticipated that most 
of the errors made would be omission of sub-steps In complex manipulations, as Instanced 
earlier {changing the side but NOT the sign of a number, only multiplying out anna of the 
elements in a bracket). It. this experiment we encountered pupils who viewed the tasks totally 
differently from the way it was presented, and we have referred to this class of errors as 
PARSING errors. 
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This seems a useful distinction, and one which may be of particular Importance when this 
information 1s used in remedial instruction. That is, different explanatipis may well be 
necessary to overcome these two classes of error. In the case of the manipulative maWules it 
would appear that the pupil basically knows the rule, but due to cognitive. overload, or 
inattention omits sub-steps. The parsing errors appear to arUa frgm a profound 
misunriftr* tending of. algebraic notation. 

It was important to determine whether, once a pupil's shortcomings have been diagnosed, it 
is possible to carry out remedial instruction which will lead to a long-term improvement in the 
pupiTs solving of algebraic aquations. As a high percentage of the group, mishandled mixed 
expressions of the form 2+3'X ■ 6, this and related points were dealt witlj in a class lesson. 
Those pupils with very Individualistic difficulties were seen separately by the Investigator, 
who spent on average half an hour with each pupil. The post-test was administered two months 
after the completion of the remedial teaching. The results for the post-test are summarized 1n 
figures 7 and 8. In order to factor out effects of maturation and subsequent instruction the 
post-test was also given to pupils who had aal been screened earlier; the mathematics teacher 
paired the pupils on the basis of their performance on an algebra test taken in January 1981. 

[Figures 7 and 8 about here] 

Figure 7 gi;es the performance on the post-test of the pupils who had had very 
individualistic difficulties and hence had been given personal remedia.l interviews. This 
figure also includes a summary of the matcned pupils' performance. The results in figure 7 
should be compared closely with their earlier results in figure 4b and the interviews in 
section 3. By and large the tutored pupils did much better than their matched partners. AB17 
(figures 6.3 & 6.4. II) and AB18 (figure 6.4. Ill) were now virtually perfect, A87 (figure 6.2) 
and AB11 (figure 6.1) were able to solve tasks Involving more than one variable (nb AB7 was the 
pupil with the very idiosyncratic algorithm), and AB10 who had been misparslng equations was 
now only using manipulative mal-rules. 

Further the untutored group displayed all the main classes of errors which had been 
encountered earlier, namely: 
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1. The SEARCH procedure was noted again with a sizeable number of pupils. 

2. Given a task of the form MX-N and M>N then several pupil, were unable to solve these. 

3. Precedence and Parsing problems were noted. 

4. Manipulative Hal-Rules [MSOLVE, MXTOLHS etc.]. 

5. A completely n.w set of Pars. Mal-Rules were encountered with pupil AB13M. For 
example with task-set 6, the following was observed twice: , 

M'X+N'X-P -> M«(X+N)«X-P -> M«Xa2+M«N«X-P -> 2«M*X+M«N«X-P 
and once: M»X+N»X»P -> M»(X+N)+N»X«P 

Similarly mis-parsings were given for task-sets 6, 7 and 8. These confusions appear 
to be caused by the pupil being Initially exposed to the "flow-chart" methods at one 
school and then transferred to the more traditional rule-based approach. [This has 
been confirmed by the school]. 

Figure 8 gives an overall summary of the performance of the two groups of pupils. (This 
comparison would be even more dramatic had we,given the iaUl number of errors made - rather 
than an overall classification of each ■ student's performance). From this it 1s ^ dear that 
the tutored pupils overall performance 1s very much better than the control group. Some of the 
observed Improvement can probably be attributed to the fact that the tutored/remedial group 
were given additional exposure to algebra tasks. However, we suggest that the very substantial 
improvement noted cannot be totally attributed to this additional exposure, which was only 2 
hours in total, and that it 1s reasonable to attribute the substantial effect to the 
(individualized) remediation process outline above." Although we have not demonstrated that 
this result 1s statistically significant. [4], we have «, effect factored out the two major 
factors, namely additional Instruction and natural maturation by using a matched group. 

The crucial question now is whether this. Improvement will be maintained Indefinitely: in 
this regard It 1s to be very much regretted that the planned 6 month's post-test was aai 
carried out by the school, 
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6. FURTHER WORK 

a) Enhaaca ilLft modal 1 er ' s r.ula Aal The modeller's rule set has been enhanced with the bona fide 
mal-rules of figure 3, and 1t 1s planned shortly to use the Modeller with a comparable group of 
pupils. 

b) Remedial teaching subsystem, it 1s planned to analyse the remedial teaching dialogues 
discussed above with a view to enhancing the Modelling System such that it will perform 
remedial teaching, using the techniques noted in these dialogues, and using the models Inferred 
by the Modeller. 

nj. Ilia effects an conventional classroom teaching it would appear that knowing typical errors 
(NULL . have a major Impact on tiie feed-back provided by the class-room teacher when he, or she, 
marks a set of exercises. (For Instance, he should be Immediately suspicious that the pupil 
has an Inadequate algorithm whenever he finds a pupil who 1s unable to solve tasks whose 
answers are not small positive Integer). Further, the type of dialogue which 1s reported with 
pupil AB17. figure 6.3, could well form the basis for some very valuable classroom lessons, 
where each pupil 1s asked to state the answer he got for a particular task and to explain how 
he obtained the result. (As noted above the pupils at this age are well able to articulate 
their methods, whether they are correct or Incorrect. Indeed, this technique was used 1n the 
remedial lesson which I gave). 



6. COMPARISON WITH OTHER STUDIES 

There 1s a steadily growing body of data about how pupils and students solve algebra 
tasks. [5]. Some of the earliest work was done by Paige and Simon (Paige & Simon, 1966) who 
reported considerable differences in approaches on a set of physically contradictory tasks. 
Some of their subjects set up the equations and proceeded to solve them, others noted that the 
situation was an impossible one and did not go any further. They also noted that people used a 
lot of background knowledge to solve these tasks. 



5. for a more general review of the problems of teaching Mathematics and their relationship to 
Intelligent Teaching Systems (Lovell. 1980). 
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Lewis (Lewis. 1980) 8lS o studied University students solving algebra equations and he 
reports two main observations: some students, had a super-operator, delete, which was used when 
either divide or subtract was appropriate, and secondly, most students had no mechanism by 
which possible algorithms were verified on known data. For example, if the proposed algorithm 
to add together algebraic expressions of the form: 

a/b + c/d 

did mi give the anticipated result of 3/4. when applied to known data, namely: 

1/2 +1/4 

then H should be discarded. 

The Illinois group (Davis. Jockusch & McKnight. 197a) has collected a great deal of data 
for abler high school pupils solving a series of tasks 1n both algebra and geometry. In 
particular, with algebra pupils they have reported a variety of phenomena including: 
over-generalization from Instances, using an old operator Instead of a. more recently Introduced 
one. [6]. and regression under cognitive load. (All of these have also been encountered 1n 
some form 1n this study). Further . the II 1 1no1s group have interpreted these observations 
within the framework(s) provided by Cognitive Science. 

Matz (Matz. 1982) has taken this interpretation one stage further, and has suggested a 
number of high-level schema which explain series of" observed errors, these Include her 
"extrapolation principle" which explains why a pupil who has seen the legal transformation: 

(A • B) 1/n -■> A 1/n • B 1/n 

would then write: 

(A + B) 1/n »«> A 1/n + B 1/n 
(c.f., the schema given by pupils AB17 and AB18). 

The study which seems to be most similar 1n age range and ability to ours. 1s the one just 
reported by the Chelsea Mathematics team (Kuechamann. 1981). This project sampled large 
numbers of pupils from many schools throughout the UK, and reports the percentage of various 
age groups which give different answers (Including the correct ones). Kuechemann suggests that 
It Is useful to categorize pupils Into 4 conceptual levels, namely: below late Concrete, late 
Concrete, early Formal and late Formal, corresponding to the usual Piagetian stages. Further. 



6. ♦ instead of •, • instead of Exponential 



9 

ERIC 



19 

BEST COPY 



Page 18 

he instances the types of tasks which he anticipates each group would be able to solve and the 
sorts of errors he expects each group to make on the more advanced tasks. The summary of 
competence for the several age groups is particularly Interesting, as it suggests there is a 
sharp Improvement between 13 and 14, out only a sr.all change between 14 and 16. 

Although the tasks we have used have been less varied than those used by Chelsea, we have 
also found a great improvement between the ages of 13 and 14, and a less but still substantial 
improvement between the ages of 14 and 16. Indeed the 13-year-olds 1 grasp of algebra seems to 
be very minimal, and clearly shows that, in this domain at least, pupils are unable to 
manipulate formal entities, whereas a proportion of the 14-year-olds appear to be able to do 
so. (The performance of the 13-year-olds is even more pflrplexing, in the light of a recent 
experiment which we have carried out with pre-school children (Sleeman, in preparation)). 

7. CONCLUSIONS 

Many of the observations noted during this experiment bear out the- remarks made in 
(Sleeman&Brown, 1982): 

*. .... .Perhaps more immediately, it suggests that a Coach must pay attention to the 

sequence of worked examples, and encountered task states, from which the pupil is apt to 
abstract (invent) functional invariances. This suggests that no matter how carefully an 
instructional designer plans a sequence of examples, he can never know all the intermediate 
steps and abstracted structures that a pupil will generate while solving an exercise. Indeed, 
the pupil may well produce illegal steps in his solution and from these invent illegal 
(algebraic) "principles". Implementing a system" with this level of sophistication still 
presents a major challenge to the ITS/Cognitive Science community... " 

The overall picture which is evolving from this and the studies discussed in the previous- 
section seems to be: 

1. The difficulties of learning algebra have been greatly under-estimated. 
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2. Pupils have a great facility for Inferring their m rules, or sometimes higher-level 
schema, and then using them consistently and often in inannrnpMat, situations. 

3. Few pupils have evolved mechanisms by which they can verify whether a proposed 
algorithm is feasible. (The findings of Lewis (Lewis. I960) and Matz (Matz. 1982) 
also support this observation). 

Presumably, these points are also true for many other areas within both school and 
University Mathematics. Fortunately, we now have some new techniques to help us understand the 
misunderstandings which have been pertetuated for generations. ' / 

/ ' V 
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RULE NAME 



FIN2 

SOLVE 

SIMPLIFY 

ADDSU8 

MULT 

XACDSUB 

NTORHS ■ 

REARRANGE 

XTGLHS 

BRA1 

BRA2 



Elflura 1 

a) RULES for the ALGEBRA domain (slightly stylized). 



CONDITION 



(X • M/N) 

(M • X • N) 

(X - M/N) 

(Ihs M +1- N rhs) 

(Ihs M • N rhs) 

(Ihs M»X +1- N»X rhs) 

(Ihs m • rhs) 

(Ihs +I-M +|- n»X rhs) 

(Ihs ■ +1- M»X rhs) 

(Ihs < n > rhs) 

(ihs m»<n»x +i-p> rhs) 



ACTION 

((M «)) or ((M)) 

(X ■ N/M) 6T (INFINITY) 

(X • M'/N') 

(1hs [evaluated] rhs) 

(Ihs [evaluated] rhs) 

(Ihs (M +l- N) • X rhs) 

(Ihs ■ rhs -I* M) 

(Ihs N»X +1- M rhs) 

(Ihs -1+ M»X • rhs) 

(Ihs N rhs) 

(Ihs M»N»X M»P rhs) 



M 'w!lere d 'l^'m^^uJU "I 9 " lhs & rhs ara Patterns (which may be 

!lgabri1e brSckeis. ° P " "* ° CCUr * a ° d Where " and > •'•prtMnt standard 



RULE NAME 

MSOLVE 

MNTORHS 

MXTOLHS 

M1BRA2 

M2BRA2 



b) Sfllllfl MAL-RU1.FS lj£ jJm Don^n 



CONDITION 

(M»X - N) 
(IhS +1- M - rhs) 
(lhs ■ +1- M»X rhs) 
(lhs M »<N»X +1- P> rhs) 
(lhs M«< N»X +1- P> rhs) 



ACTION 

(X - M/N) or (INFINITY) 

(lhs - rhs +1- M) 

(lhs +1- M»X » rhs) 

(lhs M*N»X +i- p rhs) 

(lhs M»N»X +1- M +i- p rhs) 



Using the same conventions as above. 

Note MSOLVE 1s the mal-rule associated with the domain rule. SOLVE etc. 
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F 1 pur 9 £ 



Protocols from which new mal rules were Inferred by the Investigator. 
NB the teacher specified the way 1n which the X-coeff icient should be 
represented. NOTE too that some of the protocols are not totally consistent; 
the investigator has given the mal-rule- which summarizes each pupil's- behaviour 
on the majority of the tasks. 



Task set 6 
Task is (2 
Task is (2 
Task is (3 
Task is (2 
Task is (3 
Task is (2 
Task is (4 



4 

3 
2 
6 
4 
4 
► 2 



X ■ 12) Pupil's solution was (1 • X 
X ■ 10) Pupil's solution was (2 • X 
X ■ li; Pupil's solution was (1 • X 
X - 10) Pupil 's solution was (1 • X 
X ■ 9) Pupil's solution was (1 • X - 
X ■ 3) Pupil's solution was (1 • X - 
X ■ 4) Pupil's solution was (8 • X ■ 



■ 3) 

■10-2-3) 

» 6 // 2) 

■ 1) 

1) 

-3 // 2) 
4) 



f igurn 2a. Protocol apparently showing M • X ■> M + X (pupil AB17), 



Task set 6 
Task is (2 
Task is (2 
Task 1s (3 
Task is (2 
Task is (6 
Task Is (5 

Figura 



4 ■ 16) Pupil's solution was (1 • X ■ 8 // 3) 
3-9) Pupil's solution was (1 • X ■ 9- // 6) 

4 ■ 6) Pupil's solution was (1 • X ■ -6) 

5 ■ 10) Pupil's solution was (1 • X ■ 10 // 7) 
4 ■ 6) Pupil's solution was (1 • X * 3 // 5) 
2-6) Pupil's solution was (1 • X ■ 6 // 7) 



Protocol apparently showing M • X + N ■> (M + N) • X (pupil AB20) 



Task set 7 

Task is (4 + 2 • X 

Task is (2 * 4 • X 

Task is*(3* ♦ 5 • X 

Task is (4 + 6 • X 

Task is (4 + 5 * X 

Task is (5 + 2 • X 



16) Pupil's solution was (1 • X ■ 8) 
14) Pupil's solution was (1 • X » 6) 
11) Pupil's solution was (1 • X » -4) 
11) Pupil's solution was (1 • X ■ -13) 
6) Pupil's solution was (1 • X ■ -14) 
8) Pupil's solution was (1 • X - -2) 



f tflure 2t. Protocol apparently showing M+N«X->M«N+X (pupil AB3) 



2 • X + 6) Pupil's solution was (1 • X ■ 6) 
2 • X + 5) Pupil's solution was (1 • X ■ 5) 
-2 • X + 7) PupiVs solution was (1 • X ■ 4) 
2 • X ► 3) Pupil's solution was (1 • X ■ 9 // 2) 
-2 • X * 8) Pupil's solution was (1 • X ■ 5) 
2 • X * 3) Pupil's solution was (1 • X - 11 // 2) 

F.iQ'jr.a 24. Protocol apparently showing MX*NX+P *> X+X=M+N+P (pupil AB1) 



Task* set 8 






Task is (4 


* 


X 


Task is (3 


« 


X 


Task is (3 


* 


X 


Task is (4 


* 


X 


Task is (4 


* 


X 


Task is (6 


* 


X 


F.tgur.ft 


24. 


Task set 7 






Task is ,(4 




2 


Task is (2 




4 


Task is (3 




5 


Task is (4 




6 


Task is (4 




5 


Task is (5 




2 




2ft. 



X 
X 
X 
X 
X 
X 



16) Pupil's solution was (1 • X ■ 2) 
14) Pupil's solution was (1 • X ■ 4 // 2) 
11) Pupil's solution was (1 • X ■ 5 // 3) 
11) Pupil's solution was (1 • X ■ 6 // 4) 
6) Pupil's solution was (1 • X ■ -8 // 4) 
8) Pupil's solution was (1 • X ■ 8 // 2) 



Protocol apparently showing M*N«X«P »> N*X=M (pupil AB7) . 
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ttU 1961 BxnwMnwnt, . 



mS?. r ?u!Ss S ' •■F» 0 in , rSi 1 ; e A"^ arSin9 " mal : ru1es and ' 7 ' 9 ■MHIomI manipulative 
n rule 8 1s a common factor .? »H" and "N" , and "<" and ">» are 
used to represent the usual algebraic brackets, 



la. M • x ♦ N • X M • X • N 

•> U • X ♦ N 

-> N ♦ X ♦ N ♦ X 

10. M • X -> H ♦ X 

2. M +■ N • X ■ ->M»N+X- 

-> M ♦ N ♦ X - 

3. M • X ♦ N - -> M ♦ X ♦ N - 

■> M • X • N ■ 

■> (M ♦ N) • X - 

«. M • X - N»P -> x - M 

5. M»X - N»X ♦ P ■> X+X-M+N+P 

6. M • X - N ♦ P -> M • X - N 

■> M • X « P 

7. M • X - N ■> X ■ N 

8 « M • X - N -> X - (N/F)/M 

■> X ■ N/(M/F) 

9. M • <N • X ♦ P> • -> M • X ♦ M • P 



F1flure Ijtflifial Uik" lot aatH iiii ifil AM whirh ru1a/«) are fncuneurt im. 

Task Sit Rules Focussed On Typical Task 

2 SOLVE 6 • X - 7 

3 ADDSUB 3 • X - 5 + 3 

4 MULT 5 ' X - 2 • 2 

5 XADDSUB 2 • X ♦ 3 • X - 10 

6 NTORHS 2 • X ♦ 4 • 18 

7 REARRANGE 4 ♦ 2 • X ■ 16 

8 XTOLHS 4 • X - 2 • X ♦ 3 

9 BRA1 2 . x - 5 • <3 ♦ 1> 

10 BRA2 6 • X ■ 2 • <2 • X ♦ 3> 

11 ADDSUB&MULT 2 • X ■ '2 ♦ 4 • 6 

12 ADDSUB&XADDSUB 2+3*X+4*X-16 

13 ADDSUB&BRA2 15*X-2+4«<2«x+3> 

14 MULT4XADDSUB 2»4»X+2»X-12 

15 MULT4BRA2 14 • X ■ 2 • 3 • <2 • X + 3> 

Where "<" and ">" are the usual algebraic brackets. 
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Figure 4& 



Comparative table showing the pupils' performance 1n May and September 1981. 
Where the figures in square brackets give the number of times the rule has been 
activated. So, for instance, pupil AB4 made 6 errors on task-set 7 1n the May 
1981 session, but was perfect on all tasks in September. However, AB13 made 6 
errors on task-set 7 1n May, and gave a very similar performance 1n September, 
(Sep figure 1 for details of the mal-rules quoted 1n this figure). 



Pupil 


Task 


Set Summary of Performance 


Summary of Performance 






1n May 


1n September 


AB2 


TS-7 


M+N»X-P -> (M+N)*X-P [7] 


m+n»x«p -> (M+ro*x*p rn 


AB3 


TS-7 


M+N«X->M*N+X 




A 0 4 


TS-7 


M * N*X -> M*N ♦ X [3] 


Correct 






-> M + N * X [3] 




ABO 


TC f 

TS-7 


M * N*X ->(M * N)*X 


Correct 




TS-8 


M*X»N*A+P->X+X-M+N+P [6] 


Comet 

W 1 I WWW 




' TS-5 


M«X*N*X"P ^M'X^N-P [3] 


2 OK, 1 Omitted. 




TS-6 


M*X*M"P->M , X+M+N"P [4] - 


2 OK,M*X+N-P->M«X-N [1] 






->M*X*N"P [2] 


AB7 


TS-3 


M*X-N*P -> X-P/M 


OK 




TS-5 


Wild 


Wild 




TS-6 


2 OK, 4 Wild 


1 Mis-Parse 




TS-7 


M *■ N • X «P -> X ■ M/N [6] 


3 Mis-Parses 




TS-8 


2 Values for X. 


AB10 


TS-6 


4 OK, 3 Wild. 


1 Wild, M«X+M , X-P-> 




TS-6 




X+X+M+N-P [1] 




5 OK. 


1 Wild, 2 Parse. 




TS-7 


M+N*X-P -> (M+N)*X»P [4] 


-> X-P-M-N [3] 




TS-8 


3 OK, 2 Wild 


M t X«N t X*P->XrX«NrP-M [3] 


AB11 


TS-7 


M*N*X-P -> (M+N)*X-P [5] 


Unchanged. 


AB12 


TS-5 


M*X+N*X-P->M+X+N+X-P [1] 


OK 






->ATX+-M"N B .r L 1 J 




AB13 


TS-7 


M+N»X-P -> (M+N)*X-P [6] 


Unchanged 


AB14 


TS-7 


2 OK, 4 Mai (MSOLVE) 


M+N»X-P->(M+N)*X-P [2] 








1 Wild 


AB17 


TS-5 


M*X+N*X -> M+X+N+X [6] 


TS-5 to B consistent but 






-> M»X»N [1] 


very curious. 


AB18 


TS-5 


7 [Pretty Wild] 


M*X+N*X-P->M+XfN+X-P [31 




TS-7 




M+N*X ->(M+N)*X [3] 




TS-8 




M*X»N*X+P -> X+X-N+P-M [3 


AB20 


TS-3 


M»X=N+P -> N*X-M+P [1] 


Mai (MSOLVE) 




TS-4 


M»X-N»P -> X-M [4] 




TS-5 


OK 


Mai (MSOLVE) 




TS-6 


M+N'X-P -> (M*N)*X-P [6] 


Mai (MSOLVE) 




TS-7 


M+N*X-P -> (M+N)*X-P [6] 


Mai (MSOLVE) 




TS-8 


Mai (MXT0LHS[1], MS0LVEC3]) 


Mai (MSOLVE) 


AB21 


TS-6 


M»X+N-P -> (M+N)»X-P [2] 


OK 






Wild [4] 
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Moure 4 

List of algebraic expressions which the pupils read: 



+ 3-7 

• X - 6 + 3 

• X + 3 • X • 10 

• X ♦ 4 • 10 

• 2 • X • lfl 

• X - 2 • X + 3 



4*3-6-2 

5 • X • 6 + 3 

6 • X - 3 • X - 12 
4 • X + 6 • 19 

6 + 2 • X - 20 

2 • X - -4 • X + 6 
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F 1 pur a SlA 
Pupil AB11; Soarching for solutions* 

(NB these and all subsequent figures are tidied up forms of the work sheets 
used, together with comments added from the verbal Interchanges which tooV 
place). \ 

a) The task given was: 4*X-2*X+6 



\ 



Pupil: Try X ■ 2 8-4+6 

8 - 10 

Try X ■ 3 12-6 + 8 
N --.,., 12-12 

So X ■ 3 



b) The task given was : 3 • X - 2 • X. .+ 6 



PuplU Try X ■ 3 9-8 + 6 

9-11 

Try X ■ 4 12-8 + 5 
12 - 13 

Try X - 4.6 13.5-9+6 
13.5 - 14 

GIVES UP 



c) The task given was: 
Pupil: Try X 



2 • X + 3 • X ■ 17 
■3 6+9-17 
16 ■ 17 



Try X ■ 4 



8+12-17 
20 - 17 



Try X ■ 3 1/2 7+10 1/2 ■ 17 
17 1/2 ■ 17 

Try X ■ 3 1/4 6 1/2+9 3/4 ■ 17 
16 1/4 ■ 17 

Try X ■ 3 1/3 6 2/3 +10-17 
16 '2/3 ■ 17 



GIVES UP. 
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Pupil AB7 on PS-5 solving equations Involving two Xs. For comparison, we 
also give 4 equations, namely l-o, which Involve only one X to show that sha 
again solves equations by searching. 

NB In this case we have included a representative part of the dialogue between 
the pupil and the investigator in the body of the text. 



a) The task given was: 2*X + 3*X-10 

The pupil wrote: 2*2+3+3- 10 

X - 2 
X - 3 



b) The task given was: 2*X+4*X-12 

The pupil wrote: 2 • 2 ' 4 • 1/2 ■ 12 

X - 2 
X - 1/2 



c) The task given was: 3*X+2*X-11 

The pupil wrote: 3*2+2+3" 11 

X - 2 
X - 3 



d) The task given was: 3*X+2*X-10 

The pupil wrote; 3*2+2+2- 10 

X - 2 
X - 2 



e) The task given was: 3*X+2*X-12 

The pupil wrote: 3*2+2+4- 12 

X - 2 
X - 4 



f) The task given was: 3*X+2*X-13 

The pupil wrote: 3*2+2+5- 13 

X - 2 
X - 5 



g) The task given was: 2*X+3*X«10 

The pupil wrote: 2*3+3+1- 10 

X ■ 3 
X ■ 1 



h) The task given was: 2 • X + 4 • X * 15 

The pupil wrote: 2*4+4 +3- 15 

X - 4 
X ■ 3 



i) The task given was: 2 • X + 4 • X ■ 1* 

The pupil wrote: 2*4+4+2- 14 

X « 4 
X ■ 2 
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J) The task given was: 2 • X V 5 • X ■ 20 

The pupil wrote: 2*6+ 5 +5- 20 

X - 6 
X ■ 6 



k) The task given was: 2 • X + 5 • X ■ 21 

The pupil wrote: 2*5+5+6- 21 

X ■ 6 
X - 6 



1) The task given was: 2 • X + 4 ■ 18 

The pupil wrote: 2 • 6 + 4 ■ 18 

X ■ 8 



m) The task given was: 2 • X + 10 ■ I • 

- Unable to do. 



n) The task given was: 2 • X + 4 ■ 16 

- Unable to do* 



0) The task given was: 2 • X + 4 ■ 14 

The pupil wrote: 2 6 + 4 ■ 14 

X - 5, 
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Pupil AB17 on task set 6. 

a) The task given was: 2 • X + 3 •' 9 

Pupil writes 1) 2X • 9 • 3 

2) X • 3 

Interviewer writes X • 9 - 3 + 2 

Interviewer: says could you say whether your step 11 above or 
what I've Just written 1s correct. 

Pupil says he really could not. 

t 

b) The task given was: 2 • X + 4 « 16 

Pupil writes 1} ZX ■ 16 - 4 

2) 2X - 12 

3) X ■ 6 * 
Interviewer writes X ■ 16 - 4 - 2 

Interviewer: says could you say whether your step 1) above or what I've Just 
written 1s correct. 4 

Pupil says his 1) probably 1s. 

Interviewer says: can you say why? 

Pupil: I'm afraid not. 

Interviewer: Now look back at the last example, there I suggested a slightly 
different method there. Would that be possible here? 

Pupil: That's right, it would. 

Interviewer: Which of these do you think is correct? 

Pupil: Really not sure. I often have a lot of methods to choose between, 
which makes 1t pretty confusing. I sometimes have as many as 6 or 8. 

[And so this conversation continues. After this point the pupil voluntarily 
offers 2 or 3 solutions to each task, as in the next task.] 



c) The task given was 4 • X ■ 2 • X + 6 

Pupil writes l)X-Z-4+6 

2) X ■ 4 

Then suggests the following reworking: 

1) 4X - 2X * + 6 

2) 4X - ax 
Then Quits. 

Interviewer: Which solution do you think is right? 
Pupil: Oh, I'm not really sure. 

Interviewer: If you were a betting man, which would you 
put your money on? 

Pupil : Probably the first. 

31 
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Mourn LA 

Examples of very consistently used MAI-RULES noted with three pupils. 

I) Pupil AB11 on task set 7. 

a) The task given was: 4 + 2 • X ■ 16 
Pupil writes 1) 6X ■ 15 

2) X - 2.0666 

b) The task given was: 2 ♦ 4 • X - u 
Pupil writes 1) 6 • X ■ 14 

2) X - 2.333 

c) Tha task given was: 3 + 6 • X - 11 
Pupil writes 1) 8 • X - 11 

(and is told she can leave it 1n that form) 

d) The task given was: 6 - 3 * X - 11 
Pupil writes 1) 2 • X ■ 11 

(and 1s told she can leave it in that form) 



II) Pupil AB17 on task set 6 

a) The task given was: 2 * X + 4 • X ■ 12 
Pupil writes l)*X*X-12-2-4 

2) X 2 ■ 6 

3) X - ROOT 6 

b) The task given was: 2*X+3*X-10 
Pupil writes l)*X*X-10-2-3 

2) X 2 ■ 6 
(and 1s told he can leave it 1n that form) 

c) The task given was: 2*X-3*X-10 
Pupil writes l)*X*X-10-2 + 3 

2) X 2 - 11 
(and Is told he can leave it in that form) 



III) Pupil AB18 on task sets 5, 6, 7 and 8. 

a) The task given was: 2 • X + 3 • X - 10 
Pupil writes 1) 2 • X ■ 10 - 2-3 

2) 2 • X ■ 5 

3) X ■ 2.6 

b) The task given was: 3 • X + 5 • X - 24 
Pupil writes 1)X+X- 24-3-5 

2) 2 • X ■ 16 

3) X - 8 

c) The task given was: 3*X+4*X+5*X«24 
Pupil writes 1)X+X+X« 24 -3-4-5 

2) 3 • X ■ 12 

3) X - 4 

d) The task given was: 2 • X + 4 ■ 20 
Pupil writes 1) X ■ 20 - 2 - 4 

2) X - 14 
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e) The task given was: 3 • X + 6 ■ 7 
Pupil writes i) X ■ 7 - 3 - fi 

2) X - -1. 

f) The task given was; 4 + 3 • x ■ 14 ' 
Pupil writes I) X ■ 14 - 3 - 4 

2) X - 7 

9) The task given was; 8 + 8 • X ■ 20 
Pupil writes 1) X ■ 20 - 6 - 8 

2) X - 9 

h) The task given was: 4 • X - 2 • X + 6 
PupH writes 1) 2 • X - -4 + 2 ♦ 8 

2) 2 • X - 4 

3) X - 2 

Pupil then wrote ljx-X-2+6-4 

2) 0 - 4 
and QUITS. 

1) The task given was: 6»X-3*X+8 
Pupil writes l) 0 ■ 4 

and QUITS. 
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Figure iL£ 
Pupil AB5 on task sats 7,3,12 and 13. 
a) The task given was: 3 + 4 • x ■ 7 

Pupil writes l)4»X*7-3 

2) 4 • \ - 4 

3) X - 1 

Interviewer writes: 7 • X ■ 7 

Interviewer: says could you say whether l) above or what I've just written 1s 
correct? 

Pupil : says what I wrote. 

Interviewer: Can you tell me why what I wrote 1s not possible. 
Pupil: It's not possible to add numbers and Xs. 



b) The task given was: fl + 8 * X ■ 12 * ' * 

it 

Pupil writes 1) 8 • X - 12 - 8 

2) 8 • X - 6 

3) X - 8/8 - 3/4 

Interviewer writes: 14 • X ■ 12 

Interviewer: says could you say whether 1) above or what I've lust written 
is correct? 

Pupil: says what I wrote. 

Interviewer: Can you. tell me why what I wrote 1s not possible. 
Pupil: It's not possible to add numbers and Xs. 
Interviewer writes: 14 + X ■ 12 

Interviewer: says could you say whether 1) above or what I've just written 
is correct? 

Pupil: says what I wrote. 

Interviewer: Can you tell me why what I wrote is not possible. 
Pupil: It's not possible to separate the number from the X. 



c) The task given was: 4 t X"2*X + 6' 

Pupil writes 1) 4 » X * 2 • X - 5 

2) 2 • X • 5 

3) X - 5/2 

Interviewer writes: X+X«4+2+5 

Interviewer: says could you say whether 1) above or what I've just written 
is correct? 

Pupil : says what I wrote. 

Interviewer: Can you tell me why what I wrote is not possible. 
Pupil: You have again separated the number from the X. 
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d) The task given was: 6*X>3«X+9 



Pupil writes 



1) 6 • X - 3 • x - g 

2) 3 • X ■ 9 

3) X - 3 



Interviewer writes: X+X-6+3+9 

Interviewer: says could you say whether 1) above or what I've just written 
is correct? 

Pupil: says what I wrote. 

Interviewer: Can you tell me why what I wrote is not possible. 

Pupil: This is again a splitting of the number and X which is not possible. 

e) The task given was: 2+3*X+4*X»16 
Pupil writes l)3*X+4«X>16-2 



2) 7 • X - 14 

3) X - 2 



f) The task given was: 3+4*X+5*X»20 



Pupil writes 



1) 4 • X .+ 5 • X ■ 20 - 3 

2) 9 • X ■ 17 

3) X ■ 17/9 



g) The task given was: 2*3*X+4»x«16 



Pupil writes 



1) 8 • X + 4 • X - 16 

2) 10 • X ■ 16 

3) X > 16/10 



h) Tha task given was: 3*4»X+6»X«20 



Pupil writes 



1) 12 • X- ♦ 6 • X 

2) 17 • X - 20 

3) X - 20/17 



20 



i} The task given was: 2 + 3 * AA ■ 6 



Pupil writes 



1) 3 • AA - 8 - 2 

2) 3 • AA " 4 

3) AA - 4/3 
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Maura 2 

A comparison between a tutored and a matched control group on a post-test 
given 2 months after the remedial teaching had bee:i completed. This table gives 
information only on those pupils who received personal remedial instruction. 
The numbers in square brackets give the number of occurrences of the phenomena, 
and TSn indicates the number of the task-set involved* 



Group A. 


Group B 


Pupils who received personal 
Remedial Instruction. ' 


| "Matched" pupils. 

1 

1 


AB7 


| * AB7M« 


TS6: MX+-N*P»> MX ■ -P+N 

Several Arithmetic Errors 
NB. TS5 : (MXfNX-P) now OK 


I f S3 : /(MX-N) unable to solve M>N 
I TS7: Precedence Problems 

TSB: (MX«NX+P) unable to *olve 


AB10 


| AB10M 


TS5: MX+NX-P-> NX+N«P[1] 
TS6: MNTORHS[l] 
TS7: Parse error[l] 
TSS: MXTOLHS[3] 


. SEARCHER?: unable to solve 
equat1ons*1f the solution 1s not 
a small positive integer. 
TSB: MXTOLHS [1] 


AB11 


AB11M 


TS6: MS0LVE[1] 

TS7: Precedence Problem [3] & j 
MSOLVE[2] | 
NB. TSS & TS8 now OK. | 


TS2: (MX-N) unable to do 1f M>N 
TS7: Precedence Problems [3] 
TSS: unable to do 
Also 6X«16->X»2 4/6-> X»2 1/4 


AB17 | 


AB17M 


TS8: MS0LVE[1] else perfect | 


TS2: MSOLVE[l] 

TS6: MNTORHS[l] 

TS6: has been wrongly Parsed. 

but correctly reworked. 


AB18 | 


AB18M 


TS5: 5X-12 «> X - 2 5/12 | 
except for this Perfact. | 


TS7: Precedence errors - but 
correct answers for tasks which 
have Integer solutions 
(SEARCHER?). 


♦ 

♦Where AB7M 1s the pupil who was matched with pupil AB7 etc. 
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F.I our a A 

An overall comparison between the performance <tf the group given remedial 
Instruction and the control group, , 



Summary of Performance! 



The Gi cup given 
remedial 
Assistance 



The Control 
Group 



Serious errors (eg. 
Parsing errors, 
Multiple Manipulative 
errors etc) 

Fairly consistent 
MANIPULATIVE Errors 

Infrequent 

MAHIPULATIVE/careless 
errors 

PERFECT 




•3 Pupils placed here had only am manipulative mal-rulo error, and hence could 
be considered to be perfect. 
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